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[57] ABSTRACT 

A method of displaying information in a computer system is 
described. The computer system includes a plurality of 
document images, a plurality of text files, and a plurality of 
positions files. A first text file of the plurality of text files 
represents optical character recognized text of a correspond- 
ing first document image of the plurality of document 
images. A first positions file of the plurality of positions files 
relates character information in the first text file to a position 
in the first document image. The computer system searches 
the plurality of text files using a search term to generate a set 
of found text files. Each found text file of the set of found 
text files includes at least a first matching text string to the 
search term; the set of found text files includes the first text 
file. The system accesses the first positions file to determine 
a first region in the first document image corresponding to 
the first matching text string. The system displays the first 
document image including displaying a first enhanced view 
of the first region, the first enhanced view being enhanced 
relative to a display of the first document image, the first 
enhanced view being determined from a previously stored 
visual enhancement definition. 

27 Claims, 16 Drawing Sheets 
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SYSTEM AND METHOD FOR DISPLAYING A method of displaying information in a computer sys- 

A GRAPHICALLY ENHANCED VIEW OF A tern. The computer system including a plurality of document 

REGION OF A DOCUMENT IMAGE IN images, a plurality of text files, and a plurality of positions 

WHICH THE ENHANCED VIEW IS fii es . A first text file of the plurality of text files representing 

CORRELATED WITH TEXT DERIVED s optical character recognized text of a corresponding first 

FROM THE DOCUMENT IMAGE document image of the plurality of document images. A first 

BACKGROUND OF THE INVENTION positions file of the plurality of positions files for relating 

. i->. 1 1 cx t . character information in the first text file to a position in the 

1. Field of Invention c , , . ~ ... . . r tl _ - 

. . , i^ii,.. r . first document image. The method comprising the following 

TTie invention relates to the field of information retrieval 3Q The m f m searches the ^ of ^ 

and display. In particular, the invention describes an into- files usin a ^ch term t0 te a set of found text files 

grated image and text storage, retrieval, and display system. Each found text filc of tne set of found text files indudes at 

2. Description of the Related Art kast a firet matcn i ng text str i ng to the search term; the set of 
Attorneys, bankers, insurance industry personnel, and found text files includes the first text file. Accessing the first 

other people, often work with large amounts of information 35 positions file to determine a first region in the first document 

in printed form. These people depend upon the persuasive image corresponding to the first matching text string. Dis- 

presentation of information. That is, being able to organize playing the first document image including displaying a first 

and present information effectively and efficiently is para- enhanced view of the first region, the first enhanced view 

mount. Some systems, such as PowerPoint® from being enhanced relative to a display of the first document 

Microsoft, Inc., or Photoshop® from Adobe Systems, Inc., 20 image, 
help users present information. Other systems, such as 

systems from Oracle Systems, Inc., help users find and BRIEF DESCRIPTION OF THE DRAWINGS 

retrieve information. However, these systems have a number ^ . .„ 

of drawbacks present invention is illustrated by way of example, 

mi j'cc * l *_ 1 j t • and not limitation, in the figures. Like references indicate 

The difference between a layman and an expert in pre- 25 e i eme nts 

sentation graphics is not in creating one graphical display, it 

is in the skill of transitioning well between graphic displays. FIG * 1 illustrates a computer system including one 

That is, to tell a story. What is missing from the above embodiment of the invention, 

systems is the combination of the organizational tools with FIG. 2 illustrates system components that can be used to 

the presentation tools to make developing a presentation 30 implement one embodiment of the invention. 

easier, faster, and less expensive. FIGS. 3, 3a and 3fc illustrate a display of the computer 

In a system, by the name of MarcoPolo 3.0, available system of FIG. 1. 

from Mainstay of Camarillo, Calif., scanned paper docu- piG. 4 illustrates a search window, 

ments are turned into electronic image files that are then FIG. 5 illustrates an embodiment of a method of gener- 

processed using an optical character recognition program. 35 ati yisual enhancements. 

Each scanned image is processed by the optical character _ ^ .„ . _ . 

recognition program and a corresponding electronic text file FIG ' 6 lllustrates a re S* 0D of interest - 

is generated. If a particular word or character cannot be FIG * 7 illustrates an enhanced image of an original 

recognized, then the text file will include the actual pixels document, 

from the original document. However, this leads to a number 40 FIG. 8 illustrates a blow-up. 

of problems. First, the full text of the document cannot be FIG. 9 illustrates a tear, 

searched because some words will not appear in the text file. Fia 10 illustrates two ' ions of mterest 

Second, the display of a retrieved file is not processed to _ .„ ... „, 

make the generation of a persuasive presentation simpler. FIG ' 11 *U uslrates an with a matte effect. 

Win Vzn Development Corporation, of Gabert, Ariz., 45 FIG - 12 illustrates character graphics, 

sells the Win Vzn™ system. In Win Vzn, images can be FIG. 13 illustrates corrected character graphics, 

scanned and retrieved. Management tools allow a user to FIG. 14 illustrates a page from a trial notebook that may 

access, view and print scanned documents. Image control be used in one embodiment of the invention, 
tools allow a user to view images by zooming, rotating and 

reversing the image. However, this system has a number of 50 DESCRIPTION OF THE PREFERRED 

drawbacks. First, there is no link between the text contained EMBODIMENT 

in the image and the actual images, thus, searches cannot be 

performed on the text of the images. Second, automated 

visual enhancements are not generated from the search 

results. 55 An improved apparatus and method for accessing and 

Therefore, what is needed is a document handling, image presenting information is described. In one embodiment, a 

processing, and image retrieval system that allows a person user can efficiently create a persuasive and effective presen- 

to perform text searches on the optically scanned, optically lalion of original document information. Given a new pre- 

character recognized, original documents. The system sentation topic, the user has the system search the text 

should automatically generate enhanced visual graphics to 60 contained in images of original documents, and/or fields 

be displayed with the original document images. Tools automatically generated from those documents, to find 

should be included that make the creation of a presentation images of documents relating to that topic. The display of 

easier, faster, and less expensive. me images is parameterized to automatically define regions 

ct \\a\a a d v nc run tKn/cNm^Ki of interest based u P° n » for example, paragraphs, sentences or 

SUMMARY OF THE INVENTION 65 words . ^ the system * fu jf ^ equivalem of 

An improved apparatus and method for accessing and a document to the spatial locations of the text on the 

presenting information is described. document image. 



Overview of One Embodiment of the Present 
Invention 
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The user then has the system automatically treat the set of A Computer System 

found images and regions with high resolution visual graph- FIG. 1 illustrates a computer system 100 upon which an 

ics to enhance the display of those images. The treatments embodiment of the invention can be implemented. In one 

are stored in a storage area, allowing the user to select, order embodiment, computer system 100 includes a workstation 

and further enhance the display of the images for a prcsen- 5 from SuQ Microsystems> Inc . of Mounlain view, Calif. In 

tatl0n * another embodiment, computer system 100 includes a per- 

The system can automatically create a presentation book sonal computer such as an IBM compatible, or a Macin- 

(e.g. a trial notebook). Each notebook page contains a tosh® from Apple Computer Inc. 

document image with bar-codes corresponding to treatments xh e computer system 100 includes a bus 101, or other 

for that document image. When the user scans a bar-code io communications hardware and software, for communicating 

with a bar-code reading device, the system accesses the information, and a processor 109, coupled with the bus 101, 

particular document image and displays it with the corre- for processing information. The processor 109 can be a 

sponding treatment. single processor or a number of individual processors that 

In one embodiment, an image storage and retrieval system can work together. The computer system 100 further 

allows a user to scan an original image to create an image 35 includes a memory 104. The memory 104 can include a 

file. Optical character recognition is performed on the image random access memory (RAM), or some other storage 

file to produce a text file and a positions file. The positions devices. The memory 104 is coupled to the bus 101 and is 

file spatially relates the characters in the text file to their for storing information and instructions to be executed by 

positions in the image file. The text file is entered into a full the processor 109. 

text database. Additionally, fields information, such as the 20 The computer system 100 can optionally include a data 

document date, is automatically extracted from the docu- storage device 107, such as a magnetic disk, a digital tape 

ment. system, or an optical disk and a corresponding disk drive. 

Using a search term, a user can then perform a full text The data storage device 107 can be coupled to the bus 101. 

and/or field based search. A number of image files may be 25 The computer system 100 can also include one, or more, 

found that correspond to the search term. The search term display devices 121 for displaying information to the user, 

can be a compilation of search terms including other search The display device 121 can be coupled to the bus 101. The 

terms. The search terms can be text strings, and/or one or display device 121 can include a frame buffer, specialized 

more fields, and/or value ranges, etc. The system automati- graphics rendering devices, a cathode ray tube (CRT), and/or 

cally creates regions of interest that define areas in the image fl«rt panel display. Alternatively, the display device 121 can 

files that correspond to the search term. Visual include an overhead, that would display the information in 

enhancements, or treatments, are then automatically created preview window 330 (shown in FIG. 3). The bus 101 can 

for these image files and regions of interest. The treatments include a separate bus for use by the display device 121 

can include highlighting a region of interest, displaying a alone. Display device 121 can display the interface for 

blow-up of that region of interest, displaying text from the 35 controlling the display of original documents 120. The 

corresponding text file or some other visual effect. The display device 121 can display an enhanced image of an 

treatments are stored in a storage area, such as a bin. The original document 199. 

user can then select which combinations of image files, An input device 122, optionally including alphanumeric 

regions of interest, and treatments to include in a presenta- and other keys, is typically coupled to the bus 101 for 

ti° n - 40 communicating information, such as command selections, to 

Importantly, a unique identification system correlates the the computer system. Input device 122 can include other 

image files, text files, treatments and regions of interest. A input devices such as a bar-code reader (possibly wireless) 

specific image file, and corresponding text file, are identified or a scanner. Another type of user input device is a cursor 

by their document id (for example, a document number or an control 123, such as a mouse, a trackball, a pen, a touch 

alphanumeric, a general descriptor or some other document 45 screen, a touch pad, a digital tablet, or cursor direction keys, 

identifier) and page id (for example, a page number, an for communicating direction information to the processor 

alphanumeric, a descriptor or some other page identifier), A 109, and for controlling the cursor's movement on the 

visual enhancement is identified by its document id, page id, display device 121. The cursor control 123 typically has two 

general visual enhancement id (script id), region of interest degrees of freedom, a first axis (e.g., x) and a second axis 

id, and specific visual enhancement id. Thus, instead of 50 ( e -g » y), which allows the cursor control 123 to specify 

having to store the relatively large enhanced visual images, positions in a plane. However, the computer system 100 is 

the system can access a specific image, script, region of not limited to input devices with only two degrees of 

interest, and treatment and, on the fly, generate the corre- freedom. 

sponding enhanced visual image. Another device which may be optionally coupled to the 

For a presentation, the user has the system print the 55 bus 101 is a hard copy device 124 which may be used for 

corresponding document images as presentation notebook printing instructions, data, or other information, on a 

pages. Each printed image includes bar-codes corresponding medium such as paper, film, slides, or other types of media, 

to different visual enhancements for that document image. A Th e oard ^Py device 124 can include a printer, 

bar-code includes the document id, page id, script id, region A sound recording and/or playback device 125 can 

of interest id, and specific visual enhancement id. The user 60 optionally be coupled to the bus 101. For example, the sound 

uses a wireless bar-code reader to scan a bar-code into the recording and/or playback device 125 can include an audio 

system. The system accesses the specific image, script, digitizer coupled to a microphone for recording sounds, 

region of interest, and treatment and, on the fly, generates the Further, the sound recording and/or playback device 125 

visually enhanced document image that corresponds to that may include speakers which are coupled to digital to analog 

bar-code. Thus, using the presentation notebook pages (e.g. 65 (D/A) converter and an amplifier for playing back sounds, 

trial notebook pages), a user can have the system quickly A video input/output device 126 can optionally be 

and simply access and display a particular enhanced image. coupled to the bus 101. The video input/output device 126 
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can be used to digitize video images from, for example, a In one embodiment, the OCR 210 automatically generates 

television signal, a video cassette recorder, and/or a video the fields information 211. The fields information 211 can be 

camera. The video input/output device 126 can include a used by the user to locate documents of interest. Importantly, 

scanner for scanning printed images. The video input/output the system automatically generates the following fields 

device 126 can generate a video signal for, for example, 5 information 211 for a scanned image: a document descrip- 

display by a television. The video input/output device 126 tion; the Bates number; the document date; the type of 

can generate a video signal to be captured by a video disk, document; and the names of people, places or objects. The 

laser/optical disk, hard drives, optical dnves, holographic fields information 2 ll can also include page numbers, 

storage devices, or videotape machines, for use in a presen- product re fe r ences, and any other information that can be 

tation on a video screen. 1Q obtained when the 0CR 2 io processes the image file 205. 

Also, the computer system 100 can be part of a computer fieIds information 211 allows a user to perform searches 

network (for example, a LAN or WAN) using an optional using special fields> i n one embodiment, a program, separate 

network connector 127, being coupled to the bus 101. In one from the 0 CR 210, extracts the fields information 211. In 

embodiment of the invention, an entire network can then one embodiment, the fields information 211 is extracted 

also be considered to be part of the computer system 100. a5 interactively with help from the user. 

An optional device 128 can be coupled to the b^lOLThe ^ QCR 21Q automaticall tes the documem 

optional device ^8 can include, for example a PCMCIA description . document descr iption includes the first 40 

(PC) card and a PCMCIA adapter. The optional device 128 CQaraclers of the text rorresponding to an im In one 

can further include an optional device such as modem or a embodime nt, the first 40 characters of a Une from the text file 

wireless network connection. 20 217 that has fewer lhan percent word speUing errQrs 

System Components are used. In another embodiment, a different number of 

Computer system 100 can execute a number of programs charactere « used and a different spelling error percentage 

and communicate with a number of system components. ^ u 

FIG. 2 illustrates a set of programs and systems components In one embodiment, the OCR 210 finds the Bates number 

that can be used in one embodiment of the invention. fo f a document by searching for a string that conforms to a 

Original documents can be scanned, processed, searched, Bates number. A conforming string is a multiple digit 

and displayed using the programs and system components of number sequence, number-letter sequence or letter-number 

FIG. 2. sequence, without any adjacent words. Words are not adja- 

The original document 201 is scanned in the scanner 200. 30 cent if lhe spacing is greater than three times the average 

The scanner 200 typically includes software to receive data word spacing °f the area. Bates numbers are also detected 

from the input device 122 and create an image file 205. In where a word is rotated differently than other words in the 

one embodiment, the image file 205 includes a photo- area * Additionally, within a document, each page should 

realistic image of the original document 201. have a Bates number and the system can automatically 

In one embodiment, the original document 201 is scanned 35 assi S D Bates numbers whe ^ it has only recognized some 

at 300 dpi. In another embodiment, other scan resolutions Bales numbe * of P*&™ » a document. For example, if a 

are used. For example, a scan resolution of 200 dpi is Bates number is detected for the first and third pages, but not 

acceptable, however, optical character recognition is not as the 56000(1 P a 6 e ' the Bates number ™ n be automatically 

effective at this scan resolution. Alternatively, 600 dpi can be assigned for the second page. If no Bates number is deter- 

used, however, the image file 205 is quite large. The scanner 40 muied for a tDe 15 Pimpled to supply the Bates 

200 may be optional where, for example, the "original number. In one embodiment, the system can prompt the user 

document" is in electronic form, such as document from a for the Bates number of ^ P a S es after the s y stem batch 

CD-ROM, or a fax received by a computer. man y P a 6 es - 

The image file 205 is communicated from the scanner 200 In one embodiment, the OCR 210 finds the document date 

to the OCR 210 and the image database 215. The OCR 210 45 b y searching for a text string that conforms to a date. The 

typically includes an optical character recognition program 0CR 21 ? searches the document by examining the text of 

and some fields information extraction routines. The optical the to P ri 8 ht quadrant of the document for a text string that 

character recognition program in one embodiment is Scan- conforms to a date. If a date is found, the date is then 

works from Xerox Corporation. In another embodiment, the standardized, that is put into a standard form, before being 

optical character recognition program is from Caere Corpo- 50 P ut into the relational database 230. If a date is not found in 

ration of Los Gatos, Calif. Other OCR programs can be the t0 P "g ht quadrant of the document, the other quadrants 

used. The fields information extraction routines extract are then searched. If no valid date is found, the user is 

specific information for the relational database 230 from the prompted to enter a date. 

information supplied by the optical character recognition The type of document can be: a letter/correspondence, a 

program. 55 memo/note, a deposition, a graphic/chart, article, and/or a 

In one embodiment, OCR 210 provides a text file 217, a news story. The type of document can be determined by 

positions file 213 and the fields information 211. The text file looking for keywords, such as "memo" or "memorandum", 

217 includes the text of the original document 201 as or bv examining the format of the document, 

determined by the OCR 210. The OCR 210 optionally The OCR 210 provides the text file 217 to the full text 

creates the positions file 213. The positions file 213 relates 60 database 220. The full text database 220, in one 

the positions of the words and characters in the text file 217 embodiment, includes the program MG from the University 

to their corresponding locations in the image file 205. In one of New Zealand. The full text database 220 indexes every 

embodiment, the positions file 213 includes an XDOC (or word of every page of the text file 217. That is, it creates a 

PDA) file generated by the OCR 210. In one embodiment, large index for every word in all the files provided to it. The 

the positions file 213 includes the text file 217. In one 65 text file 217 is then stored in a compressed format by the full 

embodiment, the full text file 217 includes the positions file text database 220. In one embodiment, the full text database 

213. keeps compressed versions of the text file 217. 
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In another embodiment, a second database is maintained 
for character graphics text and notes entered by a user. In 
another embodiment, the second database includes a number 
of other databases, each for maintaining different text infor- 
mation pertaining to an image. For example, the second 
database can include a database for the character graphics 
and another database for the notes associated with an image. 
The character graphics text is text that is displayed as part of 
a visual enhancement to an image. The notes can be any text 
that a user may want to enter for a document. Importantly, 
to perform a search of a full text database, the database first 
creates an index of every word in the full text documents. 
Creating the index can be very time consuming for a 
database with a great deal of data, such as the full text 
database 220. In one embodiment, because the second 
database will likely have much less data than the full text 
database 220 (only notes and character graphics text for 
specific documents, as opposed to the complete text of every 
document), the second database can be re-indexed much 
more quickly than the full text database 220. Thus, the 
second database can be re -indexed as the user enters text for 
a character graphics or notes. Thus, the user can perform not 
only a full text search of the text files but also of any 
character graphics text or notes entered by the user. 

In one embodiment, the scanner 200, the OCR 210, the 
full text database 220 and the relational database 230 can be 
used separately to enter the image information into the 
databases. The databases can then be accessed from the rest 
of the system. This allows, for example, a file clerk to scan 
and OCR the documents on a different computer system than 
is used to perform searches. Further, multiple scanner's can 
be used in parallel to speed up the process. In one 
embodiment, scanning and OCR'ing are done by another 
system, and the results are fed into the databases. 

A document/image ID 225 identifies each document 
image in the system. The document/image ID 225 uniquely 
identifies each document within the system. In one 
embodiment, the document/image ID 225 includes a docu- 
ment number and a page number. In another embodiment, 
the document/image ID 225 can be generated from the fields 
information 211 or can be assigned by a user. 

The OCR 210 does not have to provide a 100% accurate 
identification of the text in the image file 205. Importantly, 
the OCR 210 and the full text database 220 are used to help 
in the creation of presentations by helping the user locate 
original images. The correctness of the text file 217 is not 
crucial to the presentation because the presentation is based 
around the original images. It is the visual impact of the 
original image, and any visual enhancements to the original 
image, that allows the user to make a persuasive presenta- 
tion. Thus, the OCR 210 and the full text database 220, 
through the use of a full text search engine, that includes, for 
example, fuzzy logic and Boolean logic, allows the user to 
locate particular images and helps automate the creation of 
the presentation. Further, the fields information 21 1 can be 
used in combination with the full text database 220 search- 
ing to locate the images in which the user is interested. 

In one embodiment, the relational database 230 includes 
the Gupta database from Gupta Corp. of Menlo Park, Calif,, 
or Postgress from UC Berkeley, Calif. In another 
embodiment, other databases, such as a database from 
Sybase or Oracle, can be used. In another embodiment, 
non-relational databases can be used. 

The presentation database 240 is a database which pro- 
vides an organization for the presentation of some of the 
information in the system. That is, a user can store the 
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organization of a presentation in the presentation database 
240. The presentation database 240 receives and transmits 
organizational information 245 that describe the organiza- 
tion of a presentation. In one embodiment, the presentation 

5 database 240 stores treatment information for a presentation. 
The treatment, in combination with some general visual 
enhancement controls (called a script), tell the system how 
the document image should be displayed. A treatment 
includes a reference to a document image and a description 

10 of the visual enhancements to that document image. 
Importantly, a treatment does not have to include the actual 
enhanced image. By not storing the enhanced images, the 
data storage requirements of the system are reduced signifi- 
cantly. The treatments and the benefits of using treatments 

15 are described in greater detail below. In one embodiment, a 
treatment is referenced in the presentation database by the 
following information: a bin identifier (e.g. a bin number), 
a document identifier (e.g. a document number), a page 
identifier (e.g. a page number within the document) and a 

20 treatment identifier (e.g. a treatment number). Additional 
treatment identifying information can include a region of 
interest identifier (e.g. a region of interest number), and a 
specific treatment description (e.g. a blow-up identifier 
indicating that the region of interest should be shown as 

25 being blown- up). The treatments and the regions of interest 
are described in greater detail below. 

Note, in one embodiment, the full text and/or field based 
searches can be restricted to find only the documents already 
in a specific presentation. This feature helps a user find 

30 specific documents within a presentation. 

The control and interface 260 provides the interface to the 
user of the system and controls the interactions between the 
various components of the system. Further, the control and 
interface 260 allows the user to initiate searches, display 

35 images and organize presentations via the user terminal 280. 
During a presentation, the control and interface 260 presents 
enhanced images of original documents to the audience 
display devices 270. 

^ An important aspect of one embodiment of the invention 
is that the treatments are applied to the display of the original 
image and are not stored as a permanent change to the image 
file 205. The computer system 100 accesses the image file 
205 and the treatment and applies the visual enhancements 

45 during the presentation. This is important for a number of 
reasons. First, for legal reasons, it may be necessary to view 
the original, unenhanced image, so storing permanently 
altered images is unacceptable. Second, an image file 205 
can be stored relatively efficiently without having to include 

50 color information or high resolution visual graphics 
enhancements. Third, any difference in the display devices 
or the display environments (e.g. whether the room in which 
a presentation is being made is well lit or not may determine 
the choice between using yellow or green as a highlighting 

55 color) can be compensated for more easily because the 
visual enhancement can be more easily altered. 

In one embodiment, the programs of FIG. 2 can commu- 
nicate through inter-application communications. In one 
embodiment, ToolTalk, from Sun Microsystems of Moun- 

60 tain View, Calif., is used to allow programs to communicate 
with each other. 

Main Display 

FIGS. 3, 3a and 36 illustrate the main display of computer 
65 system 100 (the interface for controlling the display of 
original documents 120). The interface for controlling the 
display of original documents may include the following: a 
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search window 310, a preview window 330, a main menu search term used to find the document. The visual enhance- 

window 340, an organization window 350, and a bin win- ment can include a thumbnail picture of the specific visual 

dow 320, a CG (character graphics) setup/notes window 360 enhancement. For example, the visual enhancement may be 

and a text window 370 can also be part of the interface. a thumbnail picture of a highlight or a blow-up. In another 

The search window 310 allows a user to search the full 5 embodiment, the visual enhancement is a written description 

text database 220 (and the second database having the CG of ^ enhancement, for example, "blow-up" or "tear", 

text and notes text) and to the relational database 230. The The character graphics setup/notes window 360 allows 

results of a search are displayed in search window 310. A the user to view text that is to be displayed as part of a 

user may select a match from the search window 310, and treatment for of image. The character graphics setup/notes 

have it displayed in the preview window 330. The search 10 window 360 can also be used by a user to add character 

window 310 provides the search term to the appropriate graphics text and/or insert images for display and treatment 

database. A search term is not restricted to a single type of with the document image, or can be used to add notes to be 

search. A search term can be a culmination of searches by associated with the document image (not necessarily 

other search terms. For example, a search term can represent displayed). These features are described in greater detail 

a search of a set of documents having a date after Aug. 24, 15 below. 

1994; the set of documents being found by a search for The text window 370 includes the text file 217. A user can 

documents satisfying the search term "'Agreement' AND s^ect a document from the search window 310. The corre- 

'WarrantyV Further, a search term can include a combina- sponding text file 217 will be displayed in the text window, 

tion of other search terms. For example, a search term can can therj see not ooIy tne text) bul also the 

be the search term "NOT in the range Feb. 3, 1956 through 20 file, displayed. 
Aug. 24, 1994" and another search term. 

The preview window 330 displays a photo-realistic image Automated Image Enhancement 

of an original document. That is, preview window 330 will The following discussion relates to the automatic creation 

display all, or part of, one, or more, images files 205, In this 0 f presentations. In one embodiment, the user can automati- 

example, the preview window 330 is displaying an enhanced 25 cally generate visual enhancements for many images thereby 

image of an original document 199. In one embodiment, reducing the time needed to prepare a presentation. To 

multiple image preview windows 330, each including an illustrate this process, assume the user wishes to create a 

image, can be shown on the display device 121. In one closing presentation for a trial. The user wishes to include 

embodiment, a preview window 330 can display multiple documents that reference the word "agreement", 

different images. When making a presentation, only the FIG. 4 illustrates an enlarged view of the search window 

preview window 330 is displayed on the audience display 310 In this windoW) the user can enter the search term 410 

devxces Z7U using a second display driver/video card or (clue) of "Agreement." The search window 310 communi- 

some other device to provide a secondary, or independent, cates the search r t to the m text dalabase 22 0. In one 

dismay, which can be full screen. This is called the "on-air" ^ embodiment, the search window 310 communicates the 

mo search request to a full text database created from the 

Displaying a photo-realistic image is important for users positions files 213 for performance improvements. The full 

who want to make a persuasive presentation. It adds legiti- text database 220, in this example, has found seventy-two 

macy to their presentation. It is also important to see, and documents of which a subset of those are identified by found 

present, the original document without having to use the ^ documents 430. Five pages of the document number 000012 

original document. The user does not have to retrieve the include references to the word "agreement." In this case, 

document from storage for example. Further, because the because the level of detail 420 set to PAGES, references to 

original documents do not have to be retrieved from storage, a il five pages are shown. Note that a document can include 

the integrity of the original documents is maintained. That is, 0 ne or more pages; each page being a separate image 

the original documents will not be lost or damaged because 45 Assume now> that the ^ wishes (0 review afld M 

they do not have to be retrieved from storage. Further, include some or all of the ^ C0Dtaining « Agreement," 

multiple users can simultaneously view the images of the m the presemation . The user can then select the image of 

original documents. For example, in one embodiment, mul- mterest A corresp onding image is displayed in the preview 

tiple users on a network can access and view images. In window 330 ^ the usef can ickJ bok th h an(J 

another embodiment, multiple users share images by tele- 5Q read the relevam tions of the documents lo deterraine 

conferencing thereby allowing the users to discuss the whicn images to enhance and include in the presentatioil . 

contents ot an original document. ~ , , , 

„, . . • - , Unce a document, or a number of documents, have been 

The main menu window 340 provides the user with identified t0 5e included in the presentationj the user need 

general controls for the system. only xUxA the document(s)) from the ^ Tch window 310j 
The organization window 350 also allows a user to 5 5 and drag and drop it (them) into the bin window 320. In one 
generate a presentation. The organization window 350) embodiment, the drag and drop is performed by communi- 
further allows a user to organize images and then create eating the document/image ID 225 of the selected document 
treatments for those images (this is similar to process to the bin window 320. The computer system 100 then 
described in relation to FIG. 5) independently of a presen- automatically generates a number of predefined/user defined 
tatl0n - 60 treatments for each image. In this embodiment, a full image 
The bin window 320 shows a graphical representation of treatment, a top portion treatment, and a bottom portion 
the available treatments for a set of document images. Each treatment, with the regions of interest highlighted, are gen- 
treatment is shown as an icon. In one embodiment, a erated for each page. The automatically generated treat- 
treatment icon includes a treatment ID (bin number, docu- ments are displayed as icons. The user can view the treated 
ment number, page number, treatment number), a descrip- 65 images and include some or all of the treatments in a 
tion of the document (the document description field), a presentation. In previous systems, the user would be 
visual representation of the visual enhancement, and the required to manually enhance a particular image. Thus, in 
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one embodiment, the amount of work required to prepare the treatments. The user need not wait until all the treatments are 

images is reduced substantially. Further, in some systems, created to display an enhanced image. Note, in one 

the user would have to save the permanently changed image. embodiment, the system can display an enhanced image 

However, in one embodiment, the treatments are directions without first creating a treatment record. The system merely 

to the system as to how to display the image, they are not 5 applies the visual enhancements directly to the image being 

permanent changes to the image. Therefore, it is much easier displayed. 

to change the visual enhancements of many images in our At step 5 fio, the user selects a treatment icon from the bin 

system. window 320. This causes the system to access the corre- 

F1G. 5 illustrates an embodiment of a method of auto- sponding treatment record, 

matically generating enhancements for the display of an 30 At step ^ the gystem aDalyses the treatment record, 

image. A large number of document images can have visual This mc i u des identifying the image file 205 that corresponds 

enhancements automatically created using this process. FIG. t0 the treatrnent and lhe general and specific treatment 

5 also illustrates a method of displaying an enhanced image. characteristics to be applied when the image is displayed. 

At step 510, a search is performed using a search term. The other information referenced by the treatment record 

The search term can include any number of other search 15 may also be accessed (such as the regions of interest, and 

terms and can represent multiple searches. What is important any notes text associated with the image), 

is that some set of images have been identified which satisfy Al step 580> the system displays an enhanced version of 

the search term. In one embodiment, each image corre- the image by executing the treatment characteristics (general 

spends to a page of a document. and specific ) identified by the treatment record. 

At step 515 the regions of interest for the set of images M this ^ ^ usef can modif lhe visual enhancements 

are determined. Importantly, a region of interest defines an b ^ the main menu window 340 ( tQ ch me 

area of the image that correspond to the position of the ^ t ^ the iew window 330 ( tQ ch the ^ 

search term s matching text in the text file 217 or the of a ioQ of and/of ^ CG setup/not es window 

positions file 213. Tne region of interest can define any area 360 ( to ch the text bei displayed in the preview 

on the image that corresponds to the search term. The region window 330) ^ user can aJso M M treatments , of 

of mterest is desenbed in greater detail below. the aulomatical]y generated treatments, to include in a given 

At step 520, the search window 310 displays the results of presentation. To include a particular treatment in a 

the search of step 510. The user can select a subset of the presentation, the user can select the treatment by selecting a 

results for which treatments are to be created. This step is 3Q treatment icon from the bin window 320 and dragging and 

optional as the system can automatically create treatments dropping the treatment into another bin in the organization 

for all the results. window 350. 

At step 530, a test is made to determine if all the Mso note that a user can manuaUy create treatments for 

treatments have been generated for the selected results. storage in the bin window 320 Fof eX ample, the user can 

At step 550, the system creates a treatment record that has 35 select a file from the search window 310, have the corre- 

a reference to the image file 205, the positions file 213, the sponding image displayed in the preview window 330, apply 

text file 217, and the general and specific treatment charac- various visual enhancements through the main menu win- 

teristics (described below). The treatment record also refer- dow 340, and have the new treatment added to the bin 

ences the regions of interest created for a particular image. window 320. 

In one embodiment, the definitions of the regions of interest 40 

are kept in the record. In one embodiment, the regions of REGtONS OF Interest 
interest are kept in a database and are referenced by the 

treatment. In one embodiment, the treatment record also Generally, a region of interest is an area of an image that 

includes all the ASCII text for the character graphics, if any. a ™* T wishes t0 emphasize. This area may include graphics, 

The treatment record is described in greater detail below. In 45 handwriting, text, or a combination of these, 

one embodiment, the newly generated treatments are shown FIG. 6 illustrates the general model 610 of a region of 

as icons in the bin window 320. interest 600 and two example regions of interest 600. 

The treatment characteristics identify the general charac- The general model 610 can be any of a number of 

teristics and some of the specific treatment characteristics of polygons. For example, the general model 610 can be 

the automatically created treatments. The general treatments 50 defined by two, four, or six defined coordinates: {(xl, yl), 

can be included in a "script." The script defines a common (x2, y2)}; {(xl, yl), (x2, y2), (x3, y3), (x4, y4)}; {(xl, yl), 

look for all the treatments created with that script. For (x2, y2), (x3, y3), (x4, y4), (x5, y5), (x6, y6)}. Other general 

example, a general treatment characteristic called the drop models 610 could also be used, such as by defining the 

shadow defines the look of the drop shadows applied to the region of interest 600 by some other polygon or by a number 

display of an image. A specific treatment characteristic is, 55 of spline curves. However, the general model 610 requires 

for example, a blow-up that defines that a blown-up region only a few points to define the region and still provides 

of interest is to be displayed with the image. Multiple enough flexibility to identify most areas (text or otherwise) 

treatment characteristics may be combined to create one in an original image. 

treatment. For example, to create a treatment some general Regions can be defined directly by the user in the preview 

characteristics and some specific characteristics are included 60 window 330, or they can be generated from the results of a 

in the treatment. Also, multiple treatment characteristics can full text search or a fields search. By using the positions file 

be used separately to create multiple treatments for a specific 213 and the location of the matching string in the text file 

image. The user can then pick among the treatments to 217, a region of interest 600 can be generated for each hit of 

determine which one to include in the presentation. Different a search (a hit is text that matches the search term). Thus, 

treatments are illustrated in FIG. 7 through FIG. 11. 6 5 each automatically generated region of interest 600 defines 

After the treatments are created, a user can then have the an area of an original image that contains text that matches 

system display an enhanced image from one, or more, of the the search term. 
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In one embodiment, the outlines of a number of regions FIG. 8 illustrates a blow-up 810. A set of rules is used so 
of interest 600 are shown simultaneously. This can occur that the displaying of the blow-up 810 does not block the 
where, for example, a signal page has multiple occurrences region of interest 600. The set of rules examine the number, 
of text that matches a search term. Each region of interest sizes and locations of the region of interests 600, what 
600 is identified by a number. The user can then select a 5 highlights are to be applied, and how much space is avail- 
particular region of interest 600 and have a specific treat- able for displaying the image. A blow-up drop shadow 830 
ment created for it. can be automatically added. Other blow-up 810 visual 

A region of interest 600 can be within another region of enhancements can be added such as a transparency, a color, 

interest 600, a border effect and an edge effect. The boarder and edge 

The regions of interest 600 can be parameterized to be a 10 effect s can have independent transparency and color. The 

character, word, line, sentence, paragraph, or section of the blow-up drop shadow 830 can have transparency, color, 

text of the document. These regions of interest 600 can then boarder effects and edge effects independent of the blow-up 

be used to automatically generate treatments for a presen- 810 ; . Tne Mow-up drop shadow 830 can be sized and 

tation. positioned. The blow-up allows the audience to more easily 

The control and interface 260 determines "sentence" 15 860 lhe ideDlified re S ion of mlerest 600 ' 

regions of interest 600 using the following process. The text Usin g tne region of interest 600 coordinates and the size 

string matching the search term is located in the text file 217. of the blow-up area, the blow-up is generated by sampling 

The letters in front of the text string are searched until a th . e ima e e file 205 * Note that the image file 205 is usually a 

capital letter is found. If a capital letter is found, then the ni S ner resolution than the enlarged image. Therefore, in one 

positions file 213 is accessed to determine whether the space 20 embodiment, subsampling is used. However, in another 

preceding the capital letter is greater than one and one half embodiment, the image file 205 is a lower resolution than 

times the average spacing between words for that area of the | he available display resolution. In this embodiment, pixel 

image. Also, the character preceding the capital letter is interpolation is used. 

checked to determine whether it is a sentence ending char- FIG. 9 illustrates a tear 900. The tear looks like a torn 
acter (e.g. period, question mark, exclamation mark). If the 25 piece of paper. Given the region of interest 600, the control 
spacing before the capital letter is greater than one and one and interface 260 displays an enlarged view of the original 
half time the average spacing and the previous character is document. The control and interface 260 adds a torn edge 
a sentence ending character, then the capital letter is the effect. The torn edge effect can be created in a number of 
beginning of the sentence. A similar process is used to find ways. For example, it can be created from a combination of 
the end of the sentence. The region of interest 600 is then 30 fractal geometry and Gaussian blurring. In another 
defined by the position of the first character in the sentence embodiment, the torn edge is made from a random sample 
and the last character in the sentence. A constraint is placed of scanned torn paper edges. A random seed number is used 
on the sentence identifying algorithm. That is, a sentence in either case to ensure each tear looks unique. The random 
cannot extend over a paragraph boundary. Additionally, such seed number is kept as part of the treatment so that the same 
factors as embedded codes in positions files 213 can be used 35 torn edge effect will be created every time that treatment is 
to find sentences. Paragraph boundaries are defined by the applied to that enhanced image 199. Given the torn edge, a 
spacing between regioas of text on the page and factors such tear drop shadow 930 can also be displayed. The tear 900 
as embedded codes in positions files 213. can have other visual enhancements similar to those avail- 
Optionally, the user can select text strings from the text 4Q able for lhe blow-up. 
window, described above, and have the control and interface FIG. 10 illustrates a portion of the original document with 
260 generate a corresponding region of interest 600 for the two regions of interest 600: upper region of interest 1010 
image. and lower region of interest 1030; with two corresponding 

tears: upper tear 1020 and lower tear 1040. The control and 

Visual Enhancements ^ interface 260 notes the number of tears or blow-ups that are 

An important advantage is the number and types of visual to be displayed and attempts to place them so that they do 

enhancements that can be applied to the original images not overlap and/or according to various centering and sizing 

when they are displayed. FIGS. 7 through FIG. 13 illustrate rules. 

some of the high resolution visual enhancements that can be FIG. 11 illustrates the top portion of the original document 

added to the display of an original document to add impact 50 with a matte back effect. Top, bottom, middle, and full 

to a presentation. portion display can be included in a treatment. The matte 

FIG. 7 illustrates the preview window 330 with visual back effect dulls portions of the enhanced image 199 that are 

enhancements used in one embodiment of the invention. In less important. In this example, the highlighted tear 1120 is 

this example, a background 710 has been included. The emphasized by dulling the rest of the image, 

enhanced image 199 is shown. The control and interface 260 55 FIG. 12 illustrates the use of character graphics. Character 

automatically positions the enhanced image 199 in the graphics can be used when the user wishes to emphasize the 

preview window 330 according to set positioning rules. In words in a given portion of the document. In this example, 

one embodiment, the enhanced image 199 is positioned and the control and interface 260 has, given the region of interest 

sized to maintain a minimum of ten percent background 600, automatically supplied the character graphics from the 

margin around the enhanced image 199. Additionally, in one 60 text file 1210. That is, the control and interface 260 has 

embodiment, a drop shadow 730 for the enhanced image 199 accessed, using the corresponding positions file 213, the text 

is added. In the preferred embodiment, the background from the text file 217. The text has then been rendered and 

margin and the drop shadow 730 is performed for each displayed in the preview window 330. A character graphics 

image that is displayed. drop shadow 1230 can optionally be added. The character 

In this example, a highlight 720 is applied to the region of 65 graphics can also have other visual enhancements such as 

interest 600. The highlight 720 is a visual treatment that those associated with the blow-up. Note that in this example, 

draws the audiences' eye to the region of interest. the OCR 210 has introduced errors into the text file 217. 
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FIG. 13 shows the corrected character graphics 1310. The 
user has changed the character graphics. These corrections 
are stored as part of the presentation. 

Other visual effects can be included. For example, ani- 
mated character graphics can be displayed. Other animated 
visual effects can be displayed. Another visual effect is to 
display two opposing images for comparison. Another visual 
effect is to display multiple original document images in the 
form of a book. Given the automatic generation of the region 
of interest 600, or the manual selection of a region of interest 
600, the control and interface 260 can display high resolu- 
tion visual effects with the display of the original document 
image. 

In one embodiment, a "smart" treatment makes decisions 
about which visual enhancement should be displayed. For 
example, the smart treatment displays the text file informa- 
tion (FIG. 12) unless an error has been flagged by the OCR 
210 (for example, the OCR 210 can indicate an OCR error 
in the text file by inserting a where a particular character 
could not be recognized). If an error is flagged, then the 
blow-up of the region of interest is used in the treatment 
instead of displaying the text file information. 

Organizing a Presentation 

The search window 310, the organization window 350, 
the main menu window 340, and the bin window 320 allow 
the user to organize a presentation. The organization win- 
dow 350 provides a user with access to the presentation 
database 240. 

A presentation is included in the organization information 
245. In one embodiment, the presentation includes a number 
of records. Each record in the presentation database 240 
references the following: 

a document number and a page number, are sufficient to 
uniquely define the image; 

a treatment number. The treatment number identifies the 
treatment record; 

a bin number for indicating an organizational location of 
any particular information needed for the presentation; 

a script category (general visual enhancement 
characteristics) for defining the general look of a dis- 
played image (e.g. what background to include); 

character graphics text including the specific text to be 
displayed; 

matte back indicates whether to apply the matte effect; 

base image reference which indicates which portion of the 
image is to be displayed, e.g. the top, the bottom, the 
middle, or the full image; 

number of regions of interest 600. This is important for 
determining where to place blow-ups so as to not 
obscure other regions of interest. In one embodiment, 
the number of regions of interest 600 can be kept with 
the image file or elsewhere in the system; 

region of interest 600 identifiers indicate which regions of 
interest 600 will be displayed and enhanced, in one 
embodiment the region of interest 600 identifiers 
include the coordinate geometry of the regions of the 
interest 600. 

Each region of interest 600 in a presentation record 
includes a treatment for that region. This allows different 
regions of interest 600 to have different displays for the same 
image. FIG. 11 illustrates two regions of interest 600 with 
different treatments. 

As noted above, a presentation record identifies a script 
number. The script can be designed for a particular visual 
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impact depending on the type of presentation. For example, 
the script for the opening arguments may differ from the 
script for the closing arguments. The organization database 
240 or the relational database 230 can keep the scripts, 
A script includes a large description of subelements. Each 
subelement of a script stores the characteristics of 
subtreatments, these include: 
background — a raster image reference; 
page layout — indicates the placement and characteristics 
of the page; 

page types: top, bottom, middle, single, and duplex; 
transparency — of the page; 

tint color — of the page (can be used to make a document 
image look older by adding a yellow tint); 

placement — how close to the edges of preview window 
330 is the enhanced image of an original document 199 
displayed; 

drop shadow effect for the all drop shadows to be 
displayed — this includes the transparency (through to 
the raster image background), the offset: x, y, and the 
blur type (e.g. Gaussian blur), the edge effects applied, 
the boarders used, the color of the drop shadow, the size 
of the drop shadow, a pattern, and/or a shadow offset; 

page area cropping — crops the document image by a 
number of pixels (This may be needed where the 
scanner 200 has added a black edge to the original 
image. This feature can be automatically disabled if 
there is writing in the margins of the document image.); 

matte back — dulls the image; highlight — tint, color, 
transparency, the borders and the edges, additionally 
the transparency, color, and sizes for the borders and 
edges can also be included; 

blow-ups — tint, transparency, color, transparency, 
borders, edges and the color, and the transparency of 
the borders and the edges; 

tears — tint, color, transparency; and 

random seed number — for any page related pseudo- 
random effects. 

In one embodiment, a script also includes the above 
information for regions of interest 600 characteristics (e.g. 
boarders, color). A script can also include character graphics 
characteristics such as a font descriptor, a font type, bold, 
size, etc. 

A Trial Notebook 

FIG. 14 illustrates one page of a trial notebook. This trial 
notebook page is generated and used in one embodiment of 
the invention. Using a bar-code reader, a trial lawyer can 
scan in a bar-code and have the computer system access the 
particular image. The computer system then displays the 
image with the visual enhancements associated with the 
bar-code. 

The trial notebook page includes the original image 1400. 
As can be seen in the example of FIG. 14, the original image 
has been printed so as to be readable by the user. 

The trial notebook page also includes a number of regions 
of interest 600. Each 5 region of interest 600 is associated 
with a number. 

The trial notebook page also includes a number of treat- 
ment bar-codes 1410. A treatment bar-code identifies the 
document number 1420 and page number 1430 of the 
original image 1400. Also identified is the bin number 1440 
for that treatment bar-code 1410. For the three bar-codes at 
the bottom of the notebook page, an "open" (opening 



03/26/2004, EAST Version: 1.4.1 



5,9( 

17 

arguments) script is used for each. For the bottom left 
bar-code, the full image is shown. For the bottom middle 
code, only the top half of the image is shown. For the bottom 
right bar-code, only the bottom half of the image is shown. 

The treatment bar-code 1410 also includes a treatment 
number 1450 indicating the specific visual enhancement 
characteristics to be displayed. The bar-codes to the right of 
the original image 1400 have specific visual enhlancements 
for the original image 1400. These bar-codes also include the 
region number 1460 and some additional treatment infor- 
mation 1470 for the region. In this example, the top bar-code 
identifies that a highlight of the first region should be 
displayed along with general treatment characteristics asso- 
ciated with "open" . The second bar-code from the top 
indicates that a highlight and a blow-up of the second region 
of interest 600 should be displayed along with general 
treatment attributes associated with "open" . 

Thus, a user can include many trial notebook pages in a 
trial notebook. To present a particular document image, the 
user need only find the particular trial notebook page with 
the document image and scan the appropriate bar-code. 

It some circumstances it may be very important that the 
user displays a particular image quickly and efficiently. For 
example, assume that during a trial, the trial attorney needs 
to present a particular document image from the trial note- 
book to the jury. It is very important that at the moment the 
trial attorney scans the corresponding bar-code, that the 
image is displayed quickly. However, the computer system 
can support multiple users which may be using the system 
to display other graphical information (e.g. other images, 
search results, etc.). Therefore, in one embodiment, as soon 
as the attorney scans a particular bar-code, the system 
immediately goes into "on-air" mode. That is, the system 
overrides the displaying of the other graphical information 
and displays the enhanced image corresponding to the 
bar-code. In the "on-air" mode, the enhanced image is 
displayed on the audience display devices 270. 

Thus, an improved apparatus and method for accessing 
and presenting information has been described. 

What is claimed is: 

1. A method of displaying information in a computer 
system, said computer system including a plurality of docu- 
ment images, a plurality of text files, a plurality of positions 
files, a first text file of said plurality of text files representing 
optical character recognized text of a corresponding first 
document image of said plurality of document images, a first 
positions file of said plurality of positions files for relating 
character information in said first text file to a position in 
said first document image, said method comprising the steps 
of: 

said computer system searching said plurality of text files 
using a search term to generate a set of found text files, 
each found text file of said set of found text files 
including at least a first matching text string to said 
search term, said set of found text files including said 
first text file; 

accessing said first positions file and said text file, wherein 
said first positions file being derived from said first 
document image using optical character recognition, to 
determine a first region in said first document image 
corresponding to said first matching text string; 

displaying said first document image including displaying 
a first enhanced view of said first region, said first 
enhanced view being enhanced relative to a display of 
said first document image, said first enhanced view 
being determined from a previously stored visual 
enhancement definition. 
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2. The method of claim 1 further including, prior to said 
accessing said first positions file, said computer system 
detecting a selection of said first text file. 

3. The method of claim 1 wherein said displaying said first 
5 document image including displaying said first enhanced 

view of said first region includes: 

displaying a highlighted view of said first region. 

4. The method of claim 1 wherein said displaying said first 
document image including displaying said first enhanced 

30 view of said first region includes: 

displaying an enlarged view of said first region relative to 
said displaying said first document image. 

5. The method of claim 4 wherein said displaying said 
enlarged view of said first region includes: 

displaying said enlarged view of said first region relative 
to said displaying of said first document image with a 
torn edge effect. 

6. The method of claim 1 wherein said first text file 
20 includes a second matching text string, said method further 

comprising: 

accessing said first positions file to determine a second 
region in said first document image corresponding to 
said second matching text string; and 
25 wherein said displaying said first document image 
includes displaying a second enhanced view of said 
second region. 

7. The method of claim 6 wherein said displaying said 
second enhanced view of said second region includes dis- 

30 playing an enlarged view of said second region. 

8. The method of claim 1 wherein said displaying said first 
enhanced view of said first region includes: 

displaying said first matching text string in a region also 
displaying said first document image. 
35 9. The method of claim 1 wherein said displaying said first 
enhanced view of said first region includes: 
displaying a corrected version of said first matching text 
string in a region also displaying said first document 

4 0 ima S e - 

10. The method of claim 1 wherein said displaying said 

first enhanced view of said first region includes: 

displaying a user inputted text string in a region also 

displaying said first document image. 

45 11. The method of claim 1 wherein prior to determining 

said first region, accessing an amount of text indicator, said 

amount of text indicator indicating which of a word, a 

sentence and a paragraph if said first matching text string 

correspond to. 

5Q 12. The method of claim 1 wherein said displaying said 
first enhanced view of said first region includes: 
displaying a moving version of said first matching text 
string. 

13. The method of claim 1 wherein said displaying said 
55 first document image including said first enhanced view 

includes accessing and using a general display set of char- 
acteristics for said displaying said first document image. 

14. The method of claim 13 wherein said general display 
set of characteristics includes a characteristic indicating 

60 whether a drop shadow should be displayed when displaying 
said first document image. 

15. The method of claim 1 further including: 
displaying a second enhanced view of said first region, 

said second enhanced view being enhanced relative to 
65 said first enhanced view of said first region. 

16. A computer implemented method of displaying an 
enhanced view of an image on a computer system, said 
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computer system including a processor, a memory and a 
display, said processor being coupled to said memory and 
said display, said computer implemented method comprising 
the steps of: 

said computer system accessing a first enhanced view 5 
record, said enhanced view record identifying a first 
document image, a region of interest, and a set of visual 
enhancement characteristics, said region of interest 
defining a region on said first document image, said 
first document image having been used to generate a 10 
positions file and a text file through optical character 
recognition, the first document image being related to 
said positions file and said text file by a set of regions, 
said set of regions being created as part of creating said 
positions file and said text file, said region correspond- 15 
ing to a region in said set of regions; 

said computer system displaying a portion of said first 
document image; and 

said computer system displaying an enhanced view of 2Q 
said region of interest, said enhanced view being deter- 
mined by said set of visual enhancement characteris- 
tics. 

17. The computer implemented method of claim 16 
wherein said computer system accessing said first enhanced 25 
view record is in response to a field search of a plurality of 
fields data for a plurality of fields, said plurality of fields data 
corresponding to a plurality of documents. 

18. The computer implemented method of claim 17 
further including generating a document date data of said 3Q 
plurality of fields data, said method further including the 
steps of: 

accessing a text file corresponding to said first document 
image, said text file including a text string included in 
said first document image; 35 

accessing a positions file, said positions file spatially 
relating a first character in said text file to a first 
coordinate on said first document image; 

searching said text file for a date text string using said text 
file and said positions file; 40 

generating said document date data from said date text 
string; and wherein said field search includes searching 
a date field using a date search term corresponding to 
said document date data. 

19. The computer implemented method of claim 17 45 
further including generating a Bates number data of said 
plurality of fields data, said method further including the 
steps of: 

accessing a text file corresponding to said first document 
image, said text file including a text string included in 50 
said first document image; 

accessing a positions file, said positions file spatially 
relating a first character in said text file to a first 
coordinate on said first document image; 5S 

searching said text file for a Bates number text string 
using said text file and said positions file; 

generating said Bates number data from said Bates num- 
ber text string; and wherein 

said field search includes searching a Bates number field 60 
using a Bates number search term corresponding to said 
Bates number data. 

20. The computer implemented method of claim 17 
wherein said plurality of documents includes a set of docu- 
ments corresponding to a presentation. 65 

21. The computer implemented method of claim 16 
wherein said computer system accessing said first enhanced 



view record is in response to a full text search of a plurality 
of text files corresponding to a plurality of document images 
that identified said first enhanced view record. 

22. The computer implemented method of claim 16 
wherein said computer system accessing said first enhanced 
view record is in response to a record being identified by a 
bar-code reader. 

23. A computer system comprising: 
a display device; 

a memory; 

a plurality of images being stored by said memory, said 
plurality of images including a first image; 

a plurality of text files being stored by said memory, said 
plurality of images including a first text file correspond- 
ing to optical character recognized text of said first 
image; 

a plurality of positions files being stored by said memory, 
said plurality of positions files derived from optical 
character recognized text of said plurality of images, 
said plurality of positions files including a first posi- 
tions file; 

a plurality of visual enhancement definitions being stored 
by said memory, said plurality of visual enhancement 
definitions including a first treatment, said first treat- 
ment including a type of image enhancement indicator; 

a plurality of regions being stored by said memory, said 
plurality of regions including a first region, said first 
region defining a region in said first image correspond- 
ing to a portion of said first text file and said first 
positions file, said first region being defined as a result 
of optical character recognizing said first image; 

a plurality of presentation records being stored by said 
memory, said plurality of presentation records includ- 
ing a first record, said first record identifying said first 
image, said first treatment, and said first region; 

a processor, said processor being coupled to said memory 
and to said display, said processor for, in response to 
accessing said first record, causing said display to 
display at first treatment. 

24. The computer system of claim 23 wherein first region 
is defined by at least two sets of coordinates on said first 
image. 

25. The computer system of claim 23 wherein said first 
region is defined by a bottom left coordinate, a top left 
coordinate, a top right coordinate, and a bottom right coor- 
dinate. 

26. The computer system of claim 23 wherein said first 
text file includes a first positions file, said first positions file 
spatially relating an optical character recognized text in said 
first text file to a set of coordinates in said first image. 

27. A method of displaying information in a computer 
system, the computer system including a plurality of docu- 
ment images, the method comprising: 

searching a plurality of text files using a search term to 
generate a set of found files, the plurality of text files 
being derived from the plurality of document images 
using optical character recognition, the plurality of 
document images including a first document image, the 
plurality of text files including a first text file, the set of 
found files including the first text file, the first text file 
representing optical character recognized text of the 
first document image, the first text file including a text 
string matching the search term; 

accessing positions information for relating text in the 
first text file to corresponding positions in the first 
document image; 
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using the positions information to define a first region, the 
first region defining a region in the first image corre- 
sponding to the location of the text string in the first 
document image; 

displaying the first document image including displaying 5 
a first enhanced view of the first region, the first 
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enhanced view being enhanced relative to a display of 
the first document image, said first enhanced view 
being determined from a previously stored visual 
enhancement definition. 

* * * * * 
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